(H) Em:RNATIONiiL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 


(19) Worid Intellectual Property Organization 

Int^national Bureau 

(43) International Publication Date 
18 October 2001 (18.10.2001) 



PCT 


(10) International Publication Number 

wo 01/78055 Al 


(51) International Patent Classification^: G09G5/08 

(21) International Application Number: PCTAJSOl/10962 

(22) International FiUng Date: 4 April 2001 (04.04^001) 

(25) FiUng Language: English 

(26) PubUcadon Language: English 


(30) Priority Data: 
09/543,660 


5 April 2000 (05.04^000) US 


(81) Designated State (national): JP. 

(84) Designated States (regional): European patent (AT, BE, 
CH. CY. DE, DK, ES, FI. FR, GB, GfR, IE, IT. LU. MC, 
NL, PT. SE, TR). 

Published: 

— with international search report 

For two-letter codes and other abbreviations » refer to the "Guid- 
ance Notes on Codes and Abbreviations " appearing at the begin- 
ning of each regular issue of the PCT Gazette. 


(71) Applicant and 

(72) Inventor: FEINSTEIN, David, Y. [USAJS]; c/o Innoven- 
tions. Inc., 10425 Bissonnet Street, Houston, TX 77099 
(US). 


^= (54) Title: VIEW NAVIGATION AND MAGNEFICATION OF A HAND-HELD DEVICE WITH A DISPLAY 


O 



(57) Abstract: System (10) and method for view navigation and magnification of the display of hand-held devices in response to 
the orientation changes along only two axes (32 and 36) of rotation as measured by sensors (82 and 84) inside the devices. The view 
navigation system (10) is engaged and controlled by a single hand (20), which simultaneously presses two eigonomicaDy designed 
switches (62 and 64) on both sides of the hand-held device (10). In other embodiments ttte system is engaged into the view navigation 
mode in response to an operator command in the form of a finger tap, or a voice command, or predefined user gestures. The response 
curve of the view navigation to sensed changes in orientation is dynamically changing to allow coarse and fine navigation of the view. 
Various mediods are described to terminate the view navigation mode and fix the display at the desired view. Miniatoie soisors like 
accelerometers tilt sensors, or magneto-resistive sensors sense the oriraitation changes. The system (10) can be added to an existing 
hand-held device via an application inteifiace of the device. 
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Patent Application of 
David Y. Feinstein 

■for ■ ■■ , • ; 

VIEW NAVIGATION AND MAGNIFICATION OF A HAND-HELD DEVICE WITH A 
DISPLAY ; 

CROSS-REFERENCE TO RELAT^^ 
Not applicable. 

BACKGROUND - FIELD OF THE INVENTION 

The present Invention relates, in general, to the field of nrioblle computing and 
communication handrheld devices utilizing an infonmation display, specifically to view 
navigation and scrolling of a stored virtual display or a magnified image of the display 
in response to chariges of the prientation at which the device is held in one hand. 

ACKGRQUND- DESCRIPTION OF PRIOR ART 

The rapid miniaturization of complex electronic circuits and the emergence of . 
high-resolution Liquid Crystal Displays have vastly increased the number and variety 
of smart hand-held devices vvith informatipn displays. Such devices include hand- 
held computers, mobile telephones, pagers and other communication and computing 
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solutions. The success of the Internet in recent years has further increased the need 
for mobile devices that provide a large amount of information to the user on the go. 

The vast and varied contents of the Internet allow the user to access large 
chunks of information. Smart hand-held devices have undergone rapid improvement 
to enable them to communicate such information to the user. While the processing 
power, data storage capability, communication speed, and battery life of modem 
hand-held devices continue to develop at an accelerated pace, it seems that the 
information flow is limited by the small size of the display. It is clear however, that 
large displays that are used in desktop and laptop computers cannot be used in a 
small hand-held device. / 

Various approaches have been undertaken in order to overcome the display 
size limitation in hand-held information devices. Web Clipping is an approach taken 
by Palm Inc. to allow their commercially available Palm Series to browse tfie Internet. 
Web Clipping appiications were developed for popular web sites, Virtiich reispohd to 
user's queries by clipping minimal information from the accessed sites in a typically 
textual fomi. The disadvantage of Web Clipping is that limited Information is brought 
to the user, and not ail yNeb sites have the application to create the web clipping for 
theuser. In many cases, even after clipping, the amoun t oravai[able information is 
much more than can fit in one display view. 

The use of optical magnification of a small display has been adopted for virtual 
reality helmets and other applications where the display is seated at a fixed distance 
from the user's eye. For example, U.S. Patent No. 5,739,955 discloses such a virtual 
reality helmet with binocular magnifying optics. Optical magnifiers rnay appeal to 
persons with impaired vision who cannot view detailed Information in a small hand- 
held display. However, the main problem with optical magnification when used with a 
hand-held device js the difficulty of use: Such a hiand-held device and its associated 
optics must be placed at a relatively fixed place in front of the user's eyes so that the 
magnified display can stay In focus. _ , ^ 

Since large vlrtuardlsplays can Be readily storedlnWeTItiteiTm of the 

hand-held device, various solutions havis been adsiptisci tb scroll relatively large 
amounts of data on a relatively small disfilay. U.S. Patent No. 3,976,995 (Reissue 
Patent. 32,365) teaches the use of a processing display which moves the message 
across the display in a continuous fashion so that the display needs to be only large 


wo 01/78055 


PCT/USOl/10962 


enough to present a relatively small portion of the total message. While this 
approach may be useful to display simple sentences, it is not practical when 
displaying complex graphic information. And even with simple character displays, the 
user needs to wait patiently while the message is scrolling around. 

Another common approach is to equip the device with scrolling keys, usually 
marl<ed with arrows, to allow the operator to scroll the display in the desired direction. 
U.S. Patent 5,774,109 discloses a hand-held electronic book with keyboard entry to 
facilitate the operator's scrolling of the information. The problem with such manual 
scrolling acti\% is that it adds a substantial burden to the operator because both 
hands must be used when reading a large document. 

U.S. Patent 5,311 ,203 discloses a hand-held viewing apparatus that 
determines the three dimensional direction in which it is pointing and automatically 
presents infomiation to match the features visible In its field of view. This device is 
intended to observe, identify and locate stars or stellar constellations in an observed 
portion of the night sky. Once tiie exact direction of tiie device is measured, the 
device correlates the viewed objects and information stored in its database and 
displays identifying annotations near the con-esppnding objects. Since the device 
must cor relate exactly between the database information with the observed obje cts, 
an exact spatial angle, relative to earth is required, thus making the device 
prohibitively complex and expensive. 

An article titled "Situated Information Spaces and Spatially Aware Palmtop 
Computers", by George W. Fitzmaurice, Communication of the ACM, 36(7), July 
1 993, pp. 38-49, teaches how a small, portable and spatially aware palmtop computer 
can act as a window onto a 3D-situated information space. The article teaches the 
use of a complex sensor with six degrees of freedom, which provides complete 
orientation and position |rifprrnatiqn $o that the display can navigate the said 
information space, in an active map applicatipn suggested in the article, the 
experimental, unit serves as an eleptrpnic information lens for a wall-mounted map. 
"ift^heTunlt 15 moved around the ma p, ir if or r na ti qn r eiatrng-tctheTnap 's l o c ati on-just 
under tiie device is shown in the unit's display. Other applicatioris like a computer- 
augmented library and portable surrogate office are disclosed, in which the unit 
provides information based on theposit|ori and orientation of the hand-held display. 
Like the previous^ discussed patent, the main disadvantage of this solution is the 
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need of an elaborated 6D sensor which in turn requires the use of complex computing 
to detemnine both orientation and location of the moving device and con-elate such 
location and orientation to the stored infonnation space. In fact, the author's 
prototype required the use of an advanced desktop workstation to perfonm said 
computing. 

BRIEF SUMMARY OF THE iNVENTION 

With these problems in mind, the present invention seeks to provide a user 
friendly and convenient navigation of displayed information in a hand-heid device, so 
that a large arnount of data can be viewed in the reiatiyely srnall size of the device's 
display. In particular, the present invention allows the operatpr to perfonm such 
navigation of the display view using the same hand that holds the device. 

A hand-held device in accordance with the present invention has a housing 
with a display, memory means to store a virtual display, processing means, andhan 
orientation sensor responsive to changes In tiie spatial orientation »at which the device 
i s held ; The disp l ay can be set at a h avigatlon an d sctplling m ode or at a fixed :rnode. 
When the view navigation mpde is set, tiie-dlsplay scrolls the stored virtual dispjay 
under the direction of the processing means In response totiie changes in the :r- 
orientation of the device measured by the prientatioo sensor. 

When set to the fixed mode, the display remains fixed and no longer follows 
the changes In orientation. The display provides a clear visual indication during the 
view navigation mode in order to alert the operator tiiat it will scroll in response to 
changes iri the orientation of the device. 

Pursuant to a^specific embodiment of th^ present invention, the devibe further 
comprises a set of two ergonomic switches placed along both sides of the iiousing so 
that the operatbr must press both switches during the view navigation mode. Such 
arrangement ensures convenient activation of the view navlgatiorrmoGle,~as it is 
natural for the holding hand to press both switches at the same time. Also, the 
requirement that both switches must be pressed in order to activate tilie view 
navigation mode better protectis against unintentional change of the displayed view. 
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In another embodiment of the present Invention, said ergonomic switches are 
replaced inrflh means to detect a tap by the operator's finger at the bottom of the 
device, as an instruction to set said \^ew navigation mode after a short time delay. 
Once the view navigation mode is set, it remains in this mode for a preset period of 
time or as long as the operator substantially changes the orientation of the device. 

In yet another embodiment of the present invention, preset hand gestures by 
the operator, as measured by a set of orientation sensore augmented with an 
additional height sensor or acceleration sensor, communicate special commands to 
the hand-held device. For example, a quick upward Jerk of the hand-held device 
without substantial chsuige in orientation might be used to set the device to the view 
navigation mode. 

in still another embodiment of the present invention, a built-in voice recognition 
means accepts a spoken word command from the operator to enter said view 
navigation mode. 

It Is therefore an object of the present invention to provide convenient 
navigation means for scrolling a virtual display stored in a hand-held device using 
only one hand- 

The present invention is particuiariysultable for a display rnaglilf^^ 
application. Once set to magnification mode, the current view on the display can be 
arbitrarily magnified even by a large factor, and then using the view navigation mode 
to navigate the enlarged view on the display. 

it is a further object of the present invention to provide sUch single-hand 
navigation means with the same convenience for both right-handed and left-handed 
users. 

It Is another, object of the present invention to use a minimal arrangement of 
axial rotation sensors that respond only to changes in only two axes of orientation of 
the hand-held device. , ^. - 

~^it is yet another object of the presentTnve^^^^ to minimize exact correlation 
between orientation changes and actual navigation of the display in order to allow the 
use of relatively low cost coarse sensore to determine said orientation changes. 

It is also an object of the present Invention to provide smart response curves 
that change the conrelatlon between orientation changes and actual navigation of the 
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View in a dynamic fasiiion, which can also be setup In accordance to user 
preferences. 

It Is a further object of the present invention to use semi-conductor sensors 
that may be readily integrated into the single chip design of modem hand-held 
devices. 

It is still another object of the present invention to allow users with impaired 
vision or persons suffering from fersighted vision to conveniently magnify and 
navigate the display of a small mobile hand-held device. 

It is still a further object of the present invention to be adapted for 
manufacturing as an easy to add upgrade circuitry for the vast yariety.of palmtop 
computing and hand-held communication devices that are already existing on the * 
market. 

These and other objects, advantages, and features shall hereinafter appear, 
and for the purpose of illustrations, but not for limitation, exemplary embodiments of 
the present invention are described in the fdllowihg detailed description and illustrated 
In the accompanying drawings In which l\ke reference numerals designate 
corresponding elements. 


BRIEF DESCRIPTION OF THE DRAWINQ^^ 

In the drawingSi closely related figures have the sameinumber but different 
alphabetic suffbces. • . - v . 

FIG. 1A, FIG. 1B, and FIG. 10 show three subsequent views of a hand-held 
device incorporating the present invention when;it is rolled from left to right while 
navigating the virtual display of FIG. 1 p. J .. .. 

FIG. 2 indicates the relative axes of roll and pitch along which the hand-held 
"dBvlce1sTotated1rroTdertOTiavlgate:tiie^^ — 
Invention. -r, . . • 

FIG. 3 illustrates the use of the present invention as a magnifier for the display 
of a hand-held device In accordance with the present invention. 
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FIG. 4 shows an ergonomic embodiment of the present invention that uses two 
side switches to activate the view navigation mode. 

FIG. 5 is a block diagram of the embodiment in FIG. 4. 

FIG. 6 outlines the software flow diagram for the embodiment of the Invention 
of FIG 5. 

FIG. 7 is a timing chart showing an example of the time dependent response 
curve of the system to changes in orientation along one axis. 

FIG. 8 is a bloci< diagram of another embodiment of the present invention that 
uses a finger tap of the operator to set the hand-held device into view navigation 
rnode. 

FIG. 9 is a perspective view of the hand-held device of FIG. 8 showing a 
cutaway view of the finger tap sensor. 

FIG. 10 is the block diagram of the embodiment of tine present invention in the 
form of an add-on upgrade to an existing hahd-heid device. 

FIG. 1 1 shows yet another embodiment of the present invention that uses 
different sensors to track tlie orientatibn, and uses a speech recognition module to 
"aro&ptspGl^hr^miTi^^ — 

FIG. 12 is a timing chart iilustrating how the view navigation mode is entered 
and exited In accordanoe witti the present invention. 

FIG. 13A outlines the software flow diagram for the embodiment of FIG. 12C 
that remains in view navigation mode only for a fixed time period and then exits to the 
fixed mode. 

FIG. 13B outlines the software flow diagram for the embodiment of FIG. 12D 
that remains In view navigation mode as long as the operator continues to change the 
orientation of the device. ■ . 

FIG. 1 4 illustrates a further embodiment of the present invention that uses an 
additionalZ-axis accelerorneter to identify th operator's vertical hand gestures to 
enter the view navigation mode and for other commands. 

FIG. 15 illustrates the placement of the three accelerometers of the 
embodiment of FIG. 1 4 on the main PCB of the hand-held device. 
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FIG. 16 is a timing chart illustrating the use of the embodiment of the present 
invention of FIG. 14 with three accelerometers. 

FIG- 17 outlines the software flow diagram for the embodiment of FIG. 14 that 
uses a vertical movement gesture of the operator to enter and exit the view 
navigation mode. 

DETAILED DESCRIPTION OF THE INVENTION 

This invention allows hand-held communication or computing devices with a 
relatively small display to conveniently navigate a large stored virtual display with one 
hand. Such devices may include mobile computers like the commercially available 
PALM PILOT, Cassiopea, PSION, Newton, and other palmtop computers, it may also 
include various PDA devices, mobile.hand-held temiinals, advanced pagers, and a 
variety of nriobile telephones with e)qDanded iriformatipn display 

The hand-held device in accordance with the present Invention employs two,^^ 
operational modes, which throughput this document are referred to as view 
navigation-mode-and4ixed^ode.^ When set ip the view-navigation-mode, the displays 
view is automatically scrolled to follow the rotational movements of the holding hand. 
When set back to the fixed mode, the display view becomes stationary and no longer 
follows said movements of the hand. 

FIG.I shows an overview of the operation of a hand-heid device 10 built In 
accordance with the present invention when it is set to the view navigation mode. 
The device has a flat display 12 that is typically made of a LCD with optional back 
lighting, and a plurality of operational keys. The display 12 is too small to show the 
entire virtual display 30 that is stored in the hand-held device and Is shown in FIG. 
1 D. For illustration, the virtual display 30 shows a combination of easily identified 
graphical objects like a space station 26iia space shuttle 24,^ and an astronaut with 
the American flag 22, in addition to a. character message 28^ 

in FIG. 1 A, the navigation process is started when the operator's hand 20 rolls 
the device 10 to the left so that the display 12 shows the left portion of the stored 
virtual display 30. As the operator's hand 20 rolls to the right, FIG. IB shows how the 
view in the display 12 scrolls to the left, as the space shuttle picture 24 comes into 
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View. FIG. 1C further shows how the right portion of the virtual display 30 including 
the American flag 22 is viewed when the operator's hand 20 continues to roll to the 
right. 

FIG. 2 indicates the relative axes of orientation along which the hand-held 
device 10 is rotated in order to navigate the display 12 in accordance with the present 
invention. Throughout this document, I will refer to axis 32 as the Y-axis or, with 
Influence from aviation and naval terms, the roll axis. Similarly, i will refer to axis 36 
as the X-axIs or the pitch axis. In one embodiment of the present Invention, changes 
in the height at which the device 10 is held, and which are measured along the Z-axis 
40, are used to switch the view navigation mode on. Referring back to Ihe process 
shown in FIG. 1, it should be cleareven though not.shown In this drawing, that the 
display can be navigated vertically as the device 10. Is tilted back and forth along the 
pitch axis. ^ - 

While the scrolling of the display follows the chaingas In the orientation of the 
device, the rate of scrolling as well as the amount of scrolling need hot follow the 
exact amount of change in orientktion. As will be discussed below, the control 
software of the present invention smoothes the hajid movements to provide 
convenie nt navigation ev en when usi ng relatively coarse orientation sensors. 

FIG. 3 illustrates how the present invention is well adapted to provide display 
magnification and navigation of said magnified dispiay. FIG. 3A shows a hand-held 
device that displays some information 50, which may not be viewable by a user who 
suffers from impaired vision. When the user instructs the device 10 to magnify the 
view, the dispiay 12 shows a magnified portion 52 of the original Inforniatlon 50 as 
shown in FIG. SB. The de\4ce 10 can how navigate the magnified view in accordance 
with the present invention. When set to view navigation rhode, the display preferably 
includes some visviaUndication 54 to the operator, to alert that the display will be 
scrolled as the operator charigds the device orientation. The Indication shown In the 
draiwing depicts four rotated 'L' shaped 54 rharkers at the four comers of the display 
i27~ircafT^e7^f^crarefe^^ — 
beep if the disvice 10 is (equipped vi^th a sound output means. As will be discussed 
below, the visuiai indication'54 immensely benefits those embodiments of the present 
Invention that do riot use an actual switch for entering and leaving the view navigation 
mode. 
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It Should be noted that for a magnification application for persons with Impaired 
vision, the display should employ an active TFT LCD or some other display 
technologies that exhibit sharp contrast features. 

FIG. 4 shows an ergonomic embodiment of the present invention that uses two 
side switches 62 and 64 to activate the view navigation mode. The drawing illustrates 
mechanical switches that utilize springs 66 to provide tactile response to the operator. 
Other tactile switches like the sealed membrane type and capacitance strip switches 
may be used. The hand*held device 10 is set to the view navigation mode only when 
both switches are pressed by the operator, and it reverts back to f bced mode when at 
least one of the switches is disengaged. Alterhativeiy, the switches can be used to 
signal a command to enter the view navigation mode and allow the program to 
temninate the mode In accordance with the description below. While the present 
invention will work v^h one switch only, experiinentation showed that this 
arrangement of two side switches is more ergonomic and provides better intuitive 
control to the operator. . The use of two switches on both sides of the hand-held 
device seems to equally benefit both right-handed and left-handed persons. 

FIG. 5 is a block diagram of the embodiment in FIG. 4, where the view 
navigationjclrcuilry_ol_theip.resent inv^ integrated into the^main circuitry of 

the hand-held device. AH smart hand-held devices with displays 12 typically employ 
at least one micro-contr;ql!er; 100 or a microrprocesspr, memory 102 to store program 
and display data, and a display controller 104. For piarification purposes, common 
components like a power source and a keyboard interface are omitted from this and 
all other drawings. Orientation sensor circuitry 80 includes X-axis 82 and Y-axis 84 
accelerometers that are respectively mounted inside the hand-held device to align 
with axes 36 and 32 of FIG. 2. Because the view navigation according to the present 
invention provides a close loop between the user's movements and the actual 
navigation, there Is no need for an exact alignment between the sensor and the 
device axes. In fact, it is enough that the two senisors will be generally perpendicular 

to-each otber.~Also,^ny-misalignment among the-sensor-axes pf-sensrt^^ 

device's X and Y axes can be corrected by the program. Such accelerometers are 
preferably implemented by a surface, micro-machining technique that builds 
electromechanical structures in silicon, l^ie small size of micro-machined structures 
makes it economical to place the circuitry and sensors on the same die. For 
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example, a commercially available 1 micrometer CMOS process known as ''IMEMS" 
from Analog Devices Inc. created the ADXL202 accelerometer which incorporates 
two axes and circuitry to digitally generate a duty cycle modulator (DCM) output. 
Such DCM or other analog to digital conversion 86 and 88 are used to interface the 
orientation data to the micro-controller 100. The accelerometers pro\nde tilt angle 
information depending on their inclination relative to earth gravity. When the operator 
is moving, there are also small acceleration artifacts picked up by the accelerometers. 
The program can filter out such acceleration artifacts, or the operator may re-navigate 
the view to correct undesired view movements. 

The right switch 62 and the left switch 64 are connected in series to the VCC 
potential 70 (or a ground potential if reverse logic is used) so that when both are 
pressed, they connect an activation signal to the micro-controller 100 via line 72. This 
signal instructs the program of the micro-controller to set to the view navigation mode. 
If the hand-held device includes a beeper 94, the program can provide a beep to alert 
the operator that the view navigation mode is set. The micro-controller instructs the 
display controller 104 to provide a visual indication 54 as shown in FIG. 3B to the 
operator that the hand-held device is in the view navigation mode. 

D uring the view navigation mode, the micro-controller 100 translates the 

changes in pitcii and roll orientetion as communicated through lines 90 and 92 to 
navigation commands that scroll a virtual display which is stored in memory 102. For 
example, when the Y-axis accelerometer indicates that the operator has rotated the 
hand-held device 10 like in FIG. IGf to the right, the micro-controller 100 controls the 
virtual display in the memory 102 and the display controller 104 to scroll the view in 
the display 12 to the right. 

FIG. 6 outlines the software flow diagram for the embodiment of the invention 
of FIG 5. The flow from start 120 to end 134 is performed several times a second in a 
standard polling process of the micro-controller 1 00. At the initialization step at block 
122, the current boundary of the display view is marked in comparison to the stored 
virtuahdisplayrThe-statiJSiDf-botitiiavlga^^^^ 

1 24. If both switches are pressed, the system is set to view navigation mode in block 
126 providing the visual indication 54 to alert the operator that changes in orientation 
of the hand-held device will navigate the display. 
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At block 128 the pitch and roll data are acquired, stored and compared to the 
previous reading. If a change in orientation is detected at block 130] the program 
computes the new boundary for the view at block 132. It also refreshes the display to 
show the new view and it saves the new current orientation as the basis for 
comparison in the next iteration of the process. The process ends at block 134 until it 
is polled again. If the check for pressed switches at block 124 indicates that at least 
one switch is not pressed, the program turns off the navigation indication 54 and the 
process ends at block 134 until it is polled again. 

The program can be set with different response curves for computing the new 
boundary in response to changes in orientation at block 132. Rne or coaree modes of 
response can be set by the operator or can be changed dynamteally during the time 
the system is in view navigation mode. With fine response, the display view 
navigates the virtual display at a relatively slow rate in response to the orientation 
changes. With coaree response, the display vieyN changes rapidly in response to the 
orleritation changes. ' 

FIG. 7 is a timing chart showing an example of the time dependent response 
curve of the system to changes in orientation along one axis. Similar relations are 
employed along th e other orientation axis, a lt hough resp o nse fi g ures ma y be set^with. 
different biases to each axis. FIG. 7 A shows the relative resjDonse curve that is setup 
onto the program and may be modified by the operator, the relative response is 
obtained by dividing the amount of change in view havigatiori, which is a normalized 
figure proportional to \Artiat percerilage of the virtual display has been scrolled, to the 
change of orientation that caused it. Thus, the operator can achieve fine and slow 
navigation when the relative response figure is low, and coaree and ifaist navigation 
when the relative response figure Is high: FIG. 7B illustrates the reading from the 
orientation sensor on one axis as represented by the signal oh line 90 or 92 of FIG. 5. 
FIG. 7C shows the time corresponding changes in orientation along the monitored 
axis as measured by the micro-controller 100 at block 128 of FIG. 6. FIG. 7D 

illustrates-tbeJBsultingjjavigation-xrfithelview-ato^ 

by the micro-controlfer 100 at block 132 in accordance with one mod6 of operation. 
FIG. 7E illustrates the resulting navigation of the view along the monitored axis as 
computed by the micro-controller 100 in response to the same stimuli but in 
accordance with an alternate mode of operation. 
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FIG. 7A indicates tliat the device was switched to the view navigation mode at 
time t1 140, and switched bacl< to the fixed mode at time t4. During the fixed mode 
periods 144 and 146 of the drawing, the view remain fixed on the display during the 
corresponding periods 148 and 150 in FIG. 7D and FIG. 7E, even though the 
orientation sensor reports orientation changes 147 and 149 in FIG. 7C. In this 
example, from time t1 until time t2, the relative response of the system is set to fine 
navigation 152. After time t2, the relative response Is gradually increasing 154 until 
time t3 where the relative response t)ecomes coarse 156. 

During the view navigation mbdei a filtering algorithm cleans the orientation .^r-^ 
data from Jerks and other orientation ""noises". For example, while unintentional noise 
160 and 162 In FIG. 7B results in corresponding orientation change pulses 164 and 
1 66 in FIG. 7C, the program actually Ignores them and does not navigate the view as 
shown In FIG. 7D and FIG. 7E. 

FIG. 7:D illustrates the view navigation response when using a mode of 
operation that changes the navigated view only during a period of orientation 
changes. During the period 170, which occurs during the fine na>^gation, an 
orientatio n change is detected and the view is slowly navigated in response. During 
the period I74, while the relative response is dynamically changing to the coarse 
navigation, the view nayigates at an accelerated rate 176. During the period 1 80, 
which occurs during the coarse nayigation, a relatively slow orientation change 182 
results in a rapid nayigation 184 of the vaew. In this operation mode the view remains vjg j 
stationary In the absence of orientation changes. 

FIG. 7E illustrates the view navigation response when an alternate continuous 
mode of operation keeps the view navigating atthe rate and direction which was 
established during the last valid orientation change. Again, during the period 170, 
which occurs during the fine navigation, ian orientation change is detected and the 
view is slowly navigated 186 In response.' However, the view continues to navigate fn 

4be-same-direction4jhtil-a-ciiahgeJn-orientatio in period 174. A-new 

navigation rate 188 in the same direction but at a rate responsive to the reduced 
orientation rate change In period 174 is multiplied by the increase relative response at 
154. This navigation continues until period 180, which occurs during the coarse 
navigation. At that time, a relatively slow orientation change 182 results in a rapid 
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navigation 190 of tlie view. Tlie program employs a minimum response thresiiold to 
allow the navigation to stop when the operator slightly reverses the direction of 
orientation. Other modes of operation can be established as variants of those shown 
in FIG. 7D and RG- 7E. 

Such a response curve with at least two settings of fine and coarse navigation, 
which can be setup and adjusted for the individual preference of the operator, allows 
exact view navigation. At first, the operator presses the switches until the coarse 
navigation is activated 156 and the general area of the desired view is accessed. At 
that point the operator can reach fine navigation by simply deactivating the switches 
and then activating them again. Other response curves may be a fixed value, or may 
toggle from fine to coarse navigation at each subsequent entry to. view navigation 
mode. V ' 

It is also possible to tiise multi-state switches instead of the simple switches 62 
and 64 of FIG. 5 to allow the operator to select coarse and fine response directlyr 
Yet, using a dynamically changing response as described aillows certain simplicity of 
the design. > : ? ' ~ v. 

Another solution is to eliminate the switches altogether and to monitor the pitch 
-and-roll changes-fofiiser-speeific-gestures that^ll activate^e viewHiavigation nriode. 
In such an embodiment of the present invention, the program will keep an ongoing 
track of the roll amd pitch orientation in storage and will analyze it continuously to see 
if the operator's gestures have been detected. It seems that for a more reliable 
activation of the view navigation mode, an additional sensor is iBquired. 

FIG. 8 Is another embodiment of the present invention that substitutes the 
switches 62 and 64 with an activation detector.200 tiiat responds to a finger tap of the 
operator to set the hand-held device into view navigation mode. The finger tap 
detector Includes a soundA/lbration transdMcer 202 to sense the finger tap and to 
output a voltage that represents the sensed tap vibrations. The output of the sensor 
202 is connected by wire 203 to the input of arriplifier 204. The amplifier 204 is set up 
with, a certain threshold to Insure that only signals above the tiirpshold are amplffied. 
The amplified output of amplifier 204. is fitlered t>y a low pass filter 206, whose output 
is connected to the analog-tq-dlgital converter 208 to provide digital data to the micro- 
controller 1 00 via connection 212. Once the micro-controller receives a signal on 
line 212, it tries to match its frequency and length to the stored characteristics of a 
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finger tap signal, if a match is detected, tifie program sets the device to the view 
navigation mode after a preset delay from the end of the finger tap signal. Once in the 
view navigation mode, the micro-controller 100 uses the orientation change 
information from the orientation sensor 80 to navigate the display 1 2 in a similar way 
to the discussion of FIG.5. 

The finger tap sensor can be an eleotret condenser microphone or a 
piezoelectric transducer. Both types of sensors are relatively low cost and easy to 
manufacture. FIG. 9 is a perspective view of the hand-held device 10 in accordance 
with the embodiment of FIG. 8 showing a cutaway view of the finger tap sensor 202. 
The finger tap sensor 202 is attached to the bottom of the housing of the device 10, 
or it may be placed Ir) the area just beneath the top side of the display 12 where the 
operator's finger is likely to tap while the device is held by one hand. The sensor 202 
is connected by wire 203 to the circuitry described above. Proper amplification can 
insure that the device will detect all relevant finger taps lat the bottom. Such finger 
taps produce vibrations and sound patterns that are significantly different from the 
sound that may be created l;^y stylus strikes on the screen or the activation of a key 
13. The micrp-oontrollerc^n, distinguish a fingertap sound from other noises such as 
those created when the device is placed on the table. For more efficient 
manufacturing, the finger tap sensor 2Q2 can be surface mounted to the bottom of the 
RGB assembly 450 inside the device i p. 

Since there are a large variety of smart hand-held devices with displays 
already on the mariceti It is desirable that the present invention be adapted as an add- ig|) 
on upgrade device. FIG. 10 Is the block diagram of the embodiment of the present 
Invention in the form of an add-on upgrade 300 that is attached to an existing hand- 
held device 10. The add-on upgrade 300 is built on a miniature PGB that is 
connected to the mobile device 10 extemally or internally, depending on the 
expansion capability of said handrheld device. 

The add-on upgrade 300 comprises the sensors described in other 
-grnbDtiimenterDfihgiJresentlnventlonTiEB^ 
Such a microrcontroiler t^lcally Includes its ovm stored program and data memory as 
well as a communication channel 304 like UAFTT, SPC, and I2C. The micro- 
controller 302 receives the orientation changes information in lines 90 and 92 as well 
as the signal to enter or exit the view navigation mode 212. Processing the 
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orientation change data and navigation entry command as explained above, the 
micro-controller computes the desired navigation changes for the device's display 
and provides commands to the hand-held device via the communication channel 304. 
The commands, whic^ might be in the fonii of a serial protocol, interface to the hand- 
held device \^a the application interface port 310. These commands are further 
communicated to the processor on the main bpard 320, with Instructions on how the 
main board processor needs to navigate the display. All other implementations of 
the present invention as shown in FIG. 5, 11, and 14 can be also implemented as an 
add-on upgrade in similar arrangement to FIG. 10. 

The advantages of using the finger tap detector to command the entry to the 
view navigation mode is that it is less costly to manufacture them the side switches of 
FIG. 4. It Is also easier to add a view navigation system with a finger tap sensor to 
an existing hand-held device. 

FIG. 1 1 show^ yet another embodimeWt of th^ preserit invention that uses 
different sensors. The orientation sensor assembly 380 ttiat iriclUdes a magnetic 
direction sensor 364 and a'tlH sensor 368 replaces the acceierometer based 
orientation sensor 80 of FIG. 8. Various devibes are commercially ^valiable' for 
mea surin g the m agn etic dirBction of the device. F or exa mple, magneto-r esistors 


placed along axes 32 and 36 will produce driehtaf ion indications ad the device is 
moved relative to the magnetic field of the esirOn. Tilt sensors may be comprised of a 
potentiorrieter and a small weight coupled to the potentiometer that is free to rotate on 
^ a fixed axis around which the tilt is measured. Other types of commercially available 

inclinometers are made of small, liquid-filled variable resistors that change their 
resistance based on their inclination. Other type of orientation sensors known to the 
art, like laser gyros, may be used instead of the acceierometers 82 and 84. Yet 
another embodiment may employ several sets of nniagneto-reslstors to measure 
orientation changes in two degrees of freedom without the use of an inclinometer or 
the acceierometers. 

~ — ' — -TheTiavigatioiTlDommaridnm^rt^ 

of the finger tap sensor 200 of FIG. 8 to comrriand the micro-controller 100 to enter 
into view navigation mode. The speech recognition module may already be a part of 
the hand-held device 10 regardless of the view navigation feature, and as such can 
be used to allow the operator to enter the view navigation mode verbally, while still 
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holding the device in one hand. For clarity purposes, FIG. 1 1 omits the display 12, 
the display controller 104 and the memory 102 which are still connected to the micro- 
coritroller 100 as shown in FIG. 8 and FIG. 5. 

In comparing FIG. 5, 8, 1 1 , it should be clear that various combinations can be 
utilized to implement the present invention. For example, the magnetic direction 
sensor 364 and tilt sensor 368 can replace the accelerometers 82 and 84 in FIG. 5. 
In another embodiment, the speech recognition circuitry 400 may be used Instead of 
the finger tap detector 200 of FIG. 8, or the accelerometers 82 and 84 of the 
embodiment of FIG. 8 can replace the orientation sensor of FIG. 1 1 . Selection of the 
sensor should be made with a consideration of the overall structure of the hand-held 
device. In most applications, the devices that do not require moving parts and may 
be integrated into the silicori die of the rnain unit wrtll most likely prove the most cost 
efficient. 

FIG. 1 2 is a timing chart lilustratirig how the view navigation mode is entered 
and exited in the embodimerits of the. present invention that use the finger tap sensor 
of FIG. 5. The signal received from the sensor 202 on line 203 is shpwn in FIG. 12A. 
FIG. 12B shows the signal that represents the change of orientation along one axis. 
The signal 240 representing a finger tap Is detected between time t1 andt2. A 
sufficiently large time delay of t3-t2 is introdujced by the mioro-icontroller to eliminate 
any wrong orientation change readings that resuft from the finger ta^D motion. The 
orientation change signals 242 and 244 are lllceiy an artifact of the tapping by the 
operator. At tirne t3, tiie micrp-controller sets the device to the view navigation mode 
and alerts the operator with the visual indication 54. FIG. 12Qand FIG. 12D are logic 
signals indicating with logic "high" that the device Is set to the view na>dgatlon mode. 
FIG. 12C illustrates a navigation exit method by which the device remains at the view 
navigation mode 254 for a preset time of t4-t3. At time t4, the view navigation mode 
temninates to fix the displayed view, If more navigation is required, the operator 
repeats the process by tapping again at the bottom of the device. FIG. 1 2D illustrates 

-another navigation exitmetlmd by which the.j^^ at the view navigation 

mode 256 as long as the operator changes the orientation of the device. During the 
time period 246. the operator rotates the device in one direction, and during time 
period 248, the operator changes the direction of rotation. ^ During the time period 
250, which is equal to t6-^, the operator keeps the device relatively steady, and 


17 


wo 01/78055 


PCT/DSOl/10962 


therefore, the micro-controller terminates the view navigation mode 246 at time t6. 
The display will not navigate in response to renewed orientation dianges 252. 

The timing diagram of FIG. 12 can be used for other embodiments of the 
present invention. 

FIG. 13A outlines the software flow diagram for the embodiment of FIG. 12C 
that remains in view navigation mode only for a fixed time period and then exits to the 
fixed mode. The process starts at blocic 260 when the micro-controller 100 identifies 
the finger tapping or the voice command to enter the view navigation mode. At the 
initialization step at block 262, the current boundary of the display view is mariced in 
comparison to the stored virtual display. A delay cbrreisponding to the time length t3- 
t2 of FIG. 12 is introduced at block 262 to allow the device some time to stabilize after 
the finger tap. After the delay) the syistem is set to view navigation mode in block 268 
to start the view navigation. It also provides the visual Indication 54 to alert the 
operator that changes in orientation of the hand-held device will navigate the display. 
A variation of the process may activate the navigation indication 54 before block 264 
but still enter the view navigation media after the delay in block 264. A process timer . 
is activated at block 268 to limit the stay at viisw navigation mode to a-perlod of time? 
^qual to t4-t 3. Block 270 monitors the process timer: ' if the pr oc ess tim er has not 
expired, the process continues td'block 272 to acquire the pitch and: roll orientation.;: 
data, or in other embodiments of the present invention, the azimuth and inclination, 
data. The prociess at block 272 also stores the orientation data for tiie next iteration, 
and compares the new and old orientation data. If a change in orientation is detected 
at block 274, the program computes the new bouncljary for the view at block 276. It 
also refreshes the display to show the new view, arid ft saves the new current 
orientation as the basis for comparison in the next iteration of the process. The 
process continues with the next iteration at block 270 to check the process timer 
status. Once the time limit t4-t3 expires, the process turns off the navigation: 
indication 54 at block 278 and the process ends at block 280. Like any otiier real- 
time^peration^hejTiicrorcontrollerjTiayJntercuplJhe^^^ 

Also, at the end of block 276 the micro-contix)ller may allocate time through its 
operating system to other tasks, or even just wait for a preset time, to limit the 
number of iterations of tine view navigation process in blocks 270 to 276 that are 
performed each second. A proper value of iterations per second depends on the 
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selection of a coarse or fine view navigaflon mode as well as tlie response time of the 
orientation sensors, and it can be in tfie range of 5 to 30 for most practical 
applications. Tlie advantage of a fiigher number of Iterations per second is that it 
allows the navigation to match more closely the rotational movements of the hand, at 
the cost of an increased overhead on the micro-controller operatirig system. 

FIG. 13B outlines the software flow diagram for the embodiment of FIG. 12D 
that remains in view navigation mode as long as the operator continues to change the 
orientation of the device. Once the operator holds the device relatively steady for a 
preset time of t6-t5| the view navigation mode terminates. The process starts in 
blocks 260/262 and 264 as described In FIG. ISA. At blocl< 282 the process 
provides the visual indication 54 to alert the operator that changes in orientation of 
the hand-held device will navigate the display. The acquisition of orientation data in 
block 284 is similar to the discussion for block 272 of FIG. ISA. If no change is 
detected jn the orientation data at block 286, the process activateis the no-action timer 
of block 290 to t6-t5. It then continues to acquire orientation data in block 292. If no 
cha^nge in the orientation data Is detected at block 294, the process checks if the no- 
action timer has expired, if the timer expired, the view navigation mode ends in block 
278 and 280 as described in FIG 1 3A. 

If a ciiange in orientation is detected at block 286, the program computes the 
new boundary for the view at t>iock 288 ^nd refreshes the display with the new view. 
It also saves the new current orientatipn as the basis for comparison in tiie next 
Iteration of the process. Similarly, if block 294 detects a change in orientation data, it 
proceeds to block 288. Block 288 also deactivates the no-action tirner of t)lock 290 
since a rotational action has been just detected. When reviewing FIG. 13B, one 
needs to understand that the various processes are scheduled by the operating 
systems to allow the micro-controlier to perform other tasks and limit the number of 
data acquisitions per second as discussed in FIG. 1 3A. 

FIG. 1 4 illustrates a further embodiment of the present invention that uses an 
~Bdditionat"Z=(aKisr^^ 

enter the yiew navigation mode and for otlier commands. The orientation and 
movement sub-section 420 includes a Z-axis acceierometer 432 set to sense 
movjsment at the vertical axis 40 of FIG. 2, in addition to the orientation sensors 82 
and 84. The output of the acceierometer 420 is connected to the anaiog-to-digitai 
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converter 434. The analog-to-digltal converter provides a digftiar signal to the micro- 
controller 100 that Is responsive to the device's vertical movements. The program of 
the micro-controller monitors vertical acceleration changes to detect special hand 
gestures by the operator. For example, a quick up and down gesture of the operator 
may indicate a command to enter the view navigation mode. The program may be 
adapted to identify additional types of hand gestures as different commands. While 
special hand gestures may be Identified. by the set of two X and Y accelerometers, 
the program needs to Isolate the hand gesture which Is intended as a command from 
similar signals that are in response to operator navigation of the display. The Z-axIs 
accelerometer 432 provides an extra measurement to allow the program to identify 
^? vertical movements from rotational navigation motion. For clarity purposes, FIG. 15 

omits the display 12, the display controller 104 and the memory 102 which are still 
connected to the micro-controller 100 as shown in FIG. 8 and FIG. 5. 

Other sensors that provide elevation information can be used instead of the Z- 
axls accelerometer. This may include an air pressure sensor that is sensitive to: v 
changes In air pressure; or a: distance detector tiiat rrieasures the distsuice of the ^ 
device from the floor. ' ^ ' ■ 

FIG.JSJlIustratesJlie_4Dlacement of JheJhre.e^^ 

embodiment of FIG. 14 on the main PCB 450 of the hand-hsld device, the RGB 450 
cames the micro-controller 1 00, connection means 452 for the LCD display as well as 
other components, which are hot shown for clarity^ While rhany commercially 

t§l available accelerometers incorporate two or inore accelerometfers on the same chip, 

the drawing Illustrates the placement of the accelerometers assuming one 
accelerometer per chip. The X-axis accelerometer 82 and the Y-axis accelerometer 
64 are placed at a right angle to each bther. The Z-axis accelerometer 432 is 
mounted so that its sensitivity axis is perpendicular to the PGB 450. With high 
volume manufacturing, all three acceli^rorheters riiay be incorporated in the same 
chip. - . = 

— FIG. 16 Is a timing chart Illustrating the use of the embodlrnerrti^^ 
invention of FIG. 14 with three accelerometers. FIG: 'ISA shows the acceleration 
signal received from the Z-axis accelerometer 432. > FIG. 16B shows the signal that 
repiesents the change of orientation along the X-axis. FIG. 16C shows the signal that 
represents the change of orientation along the Y-axis. FIG 16D is a logic signal 
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indicating with logic "tiigh" when the device is set to the view navigation mode. We 
assume that the gesture to enter or exit view na^^gation mode is a rapid vertical up 
and down motion while the device, is at a relatively stable orientation. At period 470. 
the Z-a3ds accelerometer exhibits a strong signal 472 that corresponds to a vertical 
gesture by the operator between tinie t1 0 and t1 1 . At the same period, the other 
acceierometers show signeJs 474 and 476 since some orientation changes are 
affected even when the operator tries to Iceep the device at a relatively stable 
orientation. The micro-controller^s program detennines from this combination of 
signals that a valid operator gesture has been received to enter view navigation 
mode. After a preset time delay of t12-t1 1 the program sets the device to thp view 
navigation mode 490 at time t12. The relatively small time delay Insures that the 
program ignores artifacts 478 and 480 v\rti!ch tend to follow the entry gesture. During 
the view navigation mode, the program acquires the orientation signals 482 and 484 
to navigate the display. The program also keeps in storage a short trail of the 
accelerometer signals. 

At time t1 4, the operator makes another gesture 486. By time t1 5, the 
program completed the Identification of the gesture and exHss the view navigation 
mode. The program then returns the view to its setting just befo re the initiation of the 
gesture at time ti4 using the stored trails of the accelerometer signals. The operator 
is therefore attennpting to stabilize the view at time t13 so that the desired final view is 
present during the period 488 before the gesture to tenriinate the view navigation 
mode, if it is not desired to storB the data trail of the acceierometers so that the view ^ 
can be restored after the exit gesture, the exit method of FIG. 1 2C or RG. 1 2D may * 
be used. 

FIG. 1 7 outlines the software flow diagram for the embodiment of FIG. 1 4 ttiat 
uses a vertical movement gesture of the operator to enter arid exit view navigation 
mode. The process starts at biock'SOO In accordance with the overall tasking scheme 
of the operating systems of the micro-controller 100. The process acquires all sensor 

-dataat bloek-502-and-keeps^ata-tfail-irHT»ernory4o^ilow-dsrta-shap©^nalysis 

block 504. If the analysis currently shows no gesture, the process terminates at block 
506. Once block 504 detennines that a gesture was made, the process continues 
with the Initialization block 508 where the cun-ent boundary of the display view is 
marked in comparison to the stored virtual display. 
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A delay corresponding to the time length t12-t1 1 of FIG. 1 6 Is introduoed at 
block 509 to allow the device some time to stabilize after the gesture. After the delay, 
the system is set to view navigation nriode in block 510 to start the view navigation. It 
also provides the visual indication 54 to alert the operator that changes In orientation 
of the hand-held device will navigate the display. 

The process acquires all sensor data at block 512 and keeps a data trail In 
memory to allow gesture shape analysis at block 514. if a change in orientation Is 
detected at block 516, the program computes the new boundary for the view at block 
518. It also refreshes the display to show the new view and rt saves the new cunBnt 
orientatlori as the basis for comparison In the next iteration of the process. The 
process continues with the next Iteration at block 512 to continue the navigation of the 
view, if no change in orientation was detected in block 516, the program continues to 
monitor the sensors at block 512. If a vertical gesture is detected in block 514, the 
program uses the data trail from the accelerometers to restore the view to its state 
just before the gesture 520. It then continues to block 522 to turn off the navigation 
indication 54 and the prdcesis ends af block 524. = - . ^ 

Although the description above contains many specifications, these should not 
-be-Gonstmed-as4imrtiag-the-scppe-of Jhe invention-b 

illuistrations of sorne of the presently preferred embodiments of this invention. 

For exampie^while the embodiments above show .use of accelerometers, magnetic 
sensors and inclinometers, varipus otiier sensors can be ijsed for acquiring 
orientation information or elevation irifomiatipn. Also, while a simpip hand gesture of 
up and down movement was described, many other forms of hand gestures can be 
implen:iented amd detected. 

Thus the scope of the invention should be determined by the appended claims 
and their legal equivalents, rather than by the exarnples given. 
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CLAIMS 

What i claim as my invention is: 

1 . A view ^a^^gation system for a hand-held device having processing means and a 
display, comprising: 

means for storing a virtual display, said virtual display Is larger than said 
display so that only a portion of said virtual display can be viewed on 
said display, 

means for sensing changes in the orientation at which said device is held 
along two general^ perpendicular axes, 

interface means for converting the output of said orientation sensing means to 
a digital signal connected to said proceisslng means and responsive to 
said changes in the orientation, 

switching means for engaging and disengaging a view navigation mode of 
operation, 

means for storing a response curve lhat correlates changes in orientation to 
reiiuired changes in the viewable portion of said virtual display, 

said processing means is further adapted to change the A^ewable portion of 
said virtual display in response to said changes in orientation and in 
accditiahce with'said response curve whisn said view navigation mode 
is engaged, and to fix said viewable portion when said view navigation 
mode is disengaged. • - 

2. The system of claim 1, wherein said switching means comprises two ^rgonomic 
switches placed along the left and right sides of said de\rice so that a user of said 
device can convenieritly press both switches with the same hand that holds said 
device, and wherein said view navigation mode is activated when both switches 
are pressed sirnultaneously; 

3. I he system of claim 1 , where l rt sa i d swi tehlng means comprises 1 1 leai m for 
detecting the characteristic-'souhd and vibration pattem of an operator's finger tap 
on the housing of said device, whereby said view navigation mode Is engaged 
after a finger tap is detected. 
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4. The systems of claim 3, wherein said means for detecting the sound and vibration 
pattern of a finger tap comprises: 

means for converting finger tap vibrations to a corresponding electrical signal, 

amplifying means with a threshold limit connected to said converting means to 
amplify said electrical signal which exceeds the threshold limit, 

low pass fitter adapted to pass only low frequency signals connected to said 
amplifying means, 

means for converting the output of said low pass filter to a digital signal 

connected to said processing means, said processing means further 
adapted to compare said signal to a template of a characteristic signal 
of a finger tap whereby it can Identify .the occurrence of a finger tap. 

5. The system of claim 1 , wherein said switching means comprises a speech 
recognition rnodule adapted to receive commands to enter and exit said view^t 
navigation mode. 

6. The system of claim 1 , wherein said orientation sensing means comprises at least 
two accelerometers adapted to serise linear acceleration representing the tilt 

angle a]ong4vyo-generally perpendicular a^es^M 

responsive to changes in said titt angles. 

7. The system of claim 1 , wherein said orientation sensing means comprises at least 
two laser gyro devices adapted to sensp angular moyemerit along two generally 
perpendicular axes and to output digitalsignals responsive to changes in the 
angular orientation of said device. 

8. The system of claim 1 , wherein said orientation sensing means comprises a 
magnetic direction sensor responsive to the direction of the device relative to the 
magneitic field bf the earth, and wherein said orientation means further comprises 
a tilt sensor whereby said magnetic direction sensor and said tilt sensor combine 
to provide orientation change data. along two generally perpendicular axes. 

9. The system of claim 8, wherein said magnetic direction sensor comprises a 
magneto-resistive device. , v- 

^O.The system of claim 1, wherein said processing means is further adapted to 
activate visual indication on said display when said view navigation mode is 
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engaged, whereby the operator is alerted that changes in the orientation of said 
device will navigate the view. 

1 1 -The system of claim 1 , wherein said hand-held device is further comprising means 
to output sound, and wherein said processing means is further adapted to sound a 
beep alerting the operator when said view navigation mode is engaged or 
disengaged. 

12. The system of dalm 1, wherein said processing means is adapted to insert a 
preset time delay between the time of acceptance of a command to enter said 
view navigation mode arid the actual initiation of ^aid view navigation mode to 
allow sufficient time for any artifact rotational signals due to the entry command to 
subside. 

13. The system of claim 1 , wherein said processing means is further adapted to 
measure time, and wherein said processing means keeps said view navigation 
mode activated for only a preset period of time in response to a command to 
activate said view navigation mode. 

14. The system of claim 1 , wherein said processing means is further adapted to 
measure time, and wherein said view navigation mode remains set until said 
processing means determines that th@ operator stops changing the orientation of 
said device for a period of time exceeding a preset time limit. 

15. The system of claihi i ; wherein said response curve changes dynamically based 
bn the duration of said view navigation mode, 

16. A view navigation system for a hand-held device having processing means, and 
a display, comprising: 

means for storing a yirtuai display, said virtual display is larger than said 

display so that only a portion of said virtual display can be viewed on 
said display, . 

means for sensing changes in the orientation at which said device is held 

along two generally perpendicular axes, 

Interface means for converting the output of said orientation sensing means to 
a digital signal connected to said processing means and responsive to 
said changes in the orientation, 
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means for storing a response cur^e that correlates changes in orientation to 
required changes in the viewable portion of said virtual display. 

said processing meeins is further adapted to monitor said changes in 

orientation to identify a predefined operator's gesture as a command to 
enter a view navigation mode, and 

said processing means is further adapted to change the viewable portion of 
said virtual display in response to said changes in orientation in 
accordance with said response curve when said view navigation mode 
is engaged. 

17. The system of claim 1 6, further comprising a linear movement sensor adapted to 
measure and output a signal corresponding to a movement of said device along 
an axis which is generally perpendicular to the plane defined by said two axes, 
said linear movement signal is connected to said processing means, and said . 
processing means is further adapted to use said linear movement signal to aid in 
the identification of said predefined operator'srgesture command to enter or to exit 
said view navigation mode. 

1 8. The system of claim 1 6, further comprising means for measuring and producing a 
digital signal responsive to the elevation ofsaid device above ground',, said , 
elevation signal is connectedrto said processing means, and said. processing^. ,t 
means is further adapted to use said elevation signal to aid In the identification of 
said predefined operator's gesture command to enter or .to exit said view 
navigation mode. 

19. The system oif claim 16, wherein said processing means is further adapted to 
store a continuous trail of the view navigation path across safd virtual display 
during said view riavigatiori mode, said processirig means is further adapted to 
identify an operator's gesture to exit said view navigation mode, and said 
processing means is further adapted upon identification of said exit gesture to 
access said continuous trail and to retrieve and to reistore the state of the view just 
before the initiation of isaid exit gesture. J. 

20. Tne system of claim 16, wherein said processing means is adapted to Insert a 
preset time delay just after the identification of said gesture to enter said view 
navigation time and the actual initiation of said view navigation mode to allow 
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sufficient time for any artifact rotational signals due to tiie entry command gesture 
to subside. 

21. The system of claim 16, wlierein said orientation sensing means comprises at 
least two accelerometers adapted to sense linear acceleration representing tlie tilt 
angle along two generally perpendicular axes and tojoutput digital signals 
responsive to clianges in said titt angles. 

22. Tiie system of claim 16, wtierein said orientation serising means comprises at 
least two laser gyro de>rices adapted to sense angular movement along two 
generally perpendicular axes and to output digital sljginals responsive to clianges 
in tlie angular orientation of said device^ 

23. The system of claim 16, wherein said orientation sensing means comprises a 
magnetic direction sensor responsive to th^ direction of the device relative to the 
magnetic field of the earth, and wherein said orientation means further comprises 
a tilt sensor whereby said magnetic direction sensor and said tilt sensor combine 
to provide orientation change data along two generally perpendicular axes. 

24iThe system of claim 16, wherein said processing means is further adapted to 
activate visual indication on said display when said view navigation mode is 
^gaged, whereby the user Is pilertetd that changes in pnentatlon or the device wiIT 
navigate the view. 

25. The system of claim 16, wherein said .hand-held device Is further comprising 
means to output sound, and wherein said processing rneans is further adapted to 
sound a beep alerting the operator wlien said view navigation mode is engaged or 
disengaged. 

26. The system of claim 16, wherein said processing means is further adapted to 
measure time, and wherein said processing means keeps said view navigation 
mode activated for only a preset period of time in response to a command to 
activate said view navigation mode. 

27. The system of claim 16, wherein said processing means is rurtner adapted to 
measure time, and wherein said view navigation mode remains set until said 
processing means detemnines that the operator stops changing tiie orientation of 
said device for a period of time exceeding a preset time limit. 
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28. The system of claim 16, wherein said response cun^e changes dynamically based 
on the duration of said view navigation mode. 

29. A method of navigating the view of the display of a hand-held device, comprising: 

creating a virtual display and marking the boundary of the initial portion of said 
virtual display to be viewed on said display, 

identifying an operator's command to enter a view navigation mode during 
which the displayed view is navigating said virtual display, 

acquiring the rotational orientation of said device during said view navigation 
mode, and identifying changes in said orientation along two generally . 
perpendicular axes, 

computing changes in view boundary in resporise to changes in ssdd rotational 
orientation of said device based on. a stored response curve, 

' outputting a new view to said display reflecting said computed view boundary, 
-and ■ : : *..■ . . - . . - - • : ♦* . , . 

returning the dispiay.to a fixed view at the termination of said view navigation; 
mode. ^ ' : . - ' , * ; c 

30. The method of clairh 29, wherein ^aid virtual display is a magnified view of ea^- 
previous view on said display. 

' 31 . The method of claim 29, wherein Said response cun/e changes dynianniically> " " 
based on the duration of Said view navigation rriode. 

32. The method of claim 29, wherein said view navigation mode is temninating 

automatically after the expiration of a preset time since its initiation. 

* i***.' "* ■ • *■* 

33. The method of cledm 29, wherein eaici vlevv navigation mode is terminating if the 

orientation of eaid device is not changing for a period longer than a preset time 
limit. 

34. T h e method of claim 29, further comprising the step of introducing a relatively 
short time delay from the identification of said operator's command to enter said 
vievv navigation mode and the actuai start of the view navigation. 
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35. The method of clialm 29, further comprising the step of activating a visual 
indication on said display when said view navigation mode is engaged, whereby 
the user Is alerted that dianges in orientation of the device will navigate the view 

36. The method of claim 29, further comprising the step of acquiring changes In the 
elevation of said device and further comprising the step of identifying operator's 
hand gesture commands which include changes in said elevation to enter or exit 
said view navigation mode. 

37. The method of claim 29, wherein said operator's commands are spoken by the 
operator and are identified by a speech recognition module. 
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This is an example of using Ihe 
navigation method of the present 
invention to view a magnified 
page. 

Such use may be beneficial for 
persons with impaired vision who. 
vwlsh to use a small hand-held 
device with a data display. 
Special visual indications are 
tumedon at the comers of the 
displc^ to indicate that the device 
is in the navigation mode. 
The user tnts the display to the 
directton of the hidden portion of 
the display to i>e viewed. 
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